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socint Locos programs account for a significant ne tax revenues 


colloctad at tho federal, state and. local ‘levels of government. r oxample, in 


\ 
Pennsylvania over 80 million dollars is spent on ‘child day care alone. ». The total 
Sute wel fare budget age year 79-00; As 3. 2 Billion dollars. For this 


reason there is a lot of legitimate’ concem as to whether social service programs 


do what hay, rikessceeter! - 4 ' a 
\ At seoms as if it wo an easy ai for soci service adninistrators, _ 


solicy and program “staff to achieve, but it has, and continues to be, very . 
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difficult; especially when attempting to assess and integrate thd fiscal, 
statistical and programmatic components of the programs. The statistical and 
fiscal aspects are relatively less difficult to asssee ba eof their quantitative 
nature, The programnatic as aah are the most difficult components to assess 
because = the many and complex variables involved. in service delivery and 
because io cisiation: policy and standards governing programs tend to be written - 
in general terms, making fit possible to interpret what is expected in many 
ditterent ways. » ’ | 


\ This article descyibes a model aeveoohd by the ceaayivanda Department 
of Public Welfare, Office of Children and Youth, Bureau of Child Development 


_ Programs for the evaluation of its child day care programs which includes the ° 


: fiscal, statistical and programmatic components .of day care programs. It is. 


currently a manual system, could be computerized. Plans are now- undexway to 
uso the model for other prograns ‘within the Office of Children and Youth and it 

is Lolt that the model js flexible enough to be used by other, states. The name ; 
of the node is Ecological ‘Paradigm for the Delivery and Assessment of Child a . 
Care (GOPAD) . . The Child Developnent Progranh Evaluation is the name of the Sie) ect 


wry - 
i} 


(CUPL) . 


‘ 


es 
Figne ‘ en 2 : | me ~~ 
Purpose. of the. \ild Devel t Program Evaluation (CDPE ect 
The géneral purpose of the CDPB project is to improve the quality of care 
for children in day care: in the State ‘of ee - 
The specific goals are to: 
(1)sDesign a set of tools suitable for use statewide by day care 
staff to License, monitor and evaluate child day care programs. 
(2) Design a system for the integration of fiscal, statistical and 
prograimatic information to provide management ang. Supervisory staff 


‘with as objective ee ene information | as possible. + 7 


“@) Be able to assure “families that child day ‘cane séevice: 
providers are in conipliance with mindmun standards ee to 
the service they are getting.” _ 


_ buprdve the State's eae ito pete technical assistante . = 
“to provider’ of child day care. 


. (5) Improve the State's abuaty to assess and provide training 
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for child care poe 


Back round - . a 


° Sion soy, in Penney ivania as in most other: states, en ‘a child is. 


. placed in the caro of someone other than a parent, there is concern that tho child's 


right to be well taken care of is at risk. This concern: has. resulted in the 


development of regulations/standards- to protect children cared-for by persons other . 


* than thoir parents. 
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Pennsylvania's child day. care service programs have been subject to minimum - 
licensure standards for many years. However, the interpretation and enforcement of | 


these standards varied because there was no “standard -way of assessing whother 


providers bi or were not in compliance with them. “Bach person responsible for 
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almost three years (197641979) and involved all levels of governmental staff, 


compliance with. ‘recouliiendations of nationally recognized chikd care~advecacy 
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determining whether a provider se! or did not meet the, standards could and often 
would interpret some standards cifferentiy. Therefore, it was not only desirable 
but essential for the project to design a standardized system for the assessment of Tes 
every component of the day care delivery system. - : “s f. 


Xe 
This part ‘of the project, designing and field testing of the CDPE; took ~ 


providers and consumers. =* ; Bs 


CDPE Des] ign 


The CDPL congists of three progranatic instruments. One instrument is usod 


to determine a pi am's compliance with State day care standards; ‘one is designed 
to determine a program's compt ith federal day care requirements > and one is 
designed ia mre a program's compliance with the recommendations of nationally | 
recognized. child care advocacy professionsi organizations. The instruments aro to 
be used on a site-specific basis and are designed to be administered separately and 
according to whether .a program is subject to state. onty ° or state and federal regulu- 
tions. ‘The peneral nature of some State and federal regulations made it necessary 


to develop standard criterja for the measurement nal a program's copa’ oe 
Intent~of the regulation. | | Simiterty, criteria for oP mama of 8 a pro . ram's 


professional organizations (the evaluation instrument) had to be developed, 


Infonwtion is gawrel hy observation, record review or interviow. : 


The, COPE addresses 16: key -component areas of ‘child day care. These areas 


_ include: 1) adyinistration; 2) environmental safbtya 3) first aid; 4) nutrition; 


5) omergency preparedness ; ; 6) transportation; 7) training; 8) record processing; 
9) record content; 10) dental health> staff health; 12) health SeIvaces 


-13) child development ; 14) special a 15) social S@LVICES ; 16) parent javciyoaone. 
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Results . - : | a ype | 
ine implementation of the CDPE has resulted in a significant. increase in the 
day care servicés programs ' comtiencs with regulatory, standards , the upgrading, of 
some services: and the avoidance of regulatory confrontations with some programs. 
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‘(See Figure’ 1) . i 2 
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| Figure 1 depicts the level of non-compliaiice in all child care programs, in 
‘is State of Penisylvania that had been evaluated as of July, 1979. As is clearly 
\ainicated, the level of noncompliance has dxdpped significantly during the 16- 
month period | (January, 1978 - July, 1979) in, which the project was operating. In 
’ Other words , child care programs went £rom én overall compliance level With State a 
and foderal regulations of 78% to 97¥ during this period. -This is an. increasa gf 
| practically 20% in less ‘thah a nee year period, | — y eS 
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The Model * = 22-204: ie | = : 
or comespad (Ecological Paradign for the Delivery and Assessment of. chiid Care) 
anne is the model (system) designed to provide the accountability needed. in the Buredu 1° 
) of Child Development Programs. The emphasis of this model is to integrate data a 

‘across three conponent areas: program. (services) ; statistical (reporting) ;" and 
fiscal. Figure 2 presents the model in a@ schematic fashion. Bcopad constitutes 


tho technology bujlt to manage the data ane collected on child care programs. ‘ 


‘the model (Lcopad) draws heavily from two sources : : 1) rese ted in ..-+ 


4 ~ the human ecology domain, lind 2) research being conducted on management info 
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la ronfenbronner, uf Toward an out Ecology of mp. Development, : 


Auerican Psychologist, July, 1977, pps. . 513-531. . 
2RAP Associates, Integrated Management Model, 1979. 7 
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Generally, resparch eieted on child care programs and children has been 
completed in a vacuum, assessing child care on one variable withdut looking at what 


- other intervening variables might impact a child care 6 program. With Ecopad, an 


attempt is made to assess a.child care program's effect on children from various 
perspectives, such as: what impact do various communities have on the day care 
program, what ‘effect does day care havé on the behavior of the chi d at home, does 
duy care atiect the responsiveness of children to adults, how does _ care affect | 


. the family as a childrearing institution, etc. 
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"Also when management information systems ee ‘been designed . ‘ieee has been 


- 


a great deal of emphasis placed on the fiscal and reporting components to an . 


cost analysis coefficients with little emphasis placed upon the programmatic 
component. Ecopad attempts to assess this area in detail. — § . 
Let's now turn our atienton to the ‘schematic of Bcopad and describe in 


: detail how the model works. The first component ‘is: the reporting or statistical 
coniponent. The first contact wate a client would be made here and would probably 


be recorded through an intake or eligibility document. The agency would need to 
assess if the client is eligible for services. In the case of day care servifes, 
it would be Title XX elig bility. Once this is accomplished, an intake document 
wi) to obtain all the other demographic ‘data, on the Client. 
With the Licopad model the eligibility and intake are the same document called 
"Ropistration for Child Day Care Services". ‘This is depicted in Figure 3 by the 
first oe capeeneyte circles. information regarding the type of service roquestod, 


number of family cobers: in the ‘household, age of a hours of care, days of 


| \ 
- Program | 


a 
oF 
ERIC 


"EVALUATION 
MONITORING 


- LICENSING 


-@ 


- Ecological Paradigm for. the Delivery of chit car ) 


= et t ry 2 . — : © $e oa * 
. oa . ‘ 7 : a Pa ais : . 
. af. ‘s * = ; . . ~\ a < ° 
Fiene | = ne a or . 8 
. 


e Py ws i \ ~~ - 
7 4 


fare, income ‘level, etc. is collected on the client. This registration document 
X\ , “ . : . 


4 is filled out at fe initial intake 
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- The, néxt concentric circle involves the monthly wesordig form called the 
sant (Service Activity Report). This form documents the services ae: on 
a tionthly base to the cliekt. This form along with the registration doctnent 
scomposes the reporting system for ligopad,, From these two documents all’ Title xX 
reporting requirements for day care.are answeréd. Reports are also preparéd for 
the State and ‘the regions on all dempgraphics for our’ clients within the day care” ) 
Title XX system. | | - ar. .— # 
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The next component to be capsidered is the fiscal component. This 
( component is broken into eight cost centers (CC100, CC200,"... C800); Bach cost 
center is for a Specific program area: CC100 pays for the adniinistration and | 
wanagenent of program, ican and accounting, " office operations , staff development ’ 
r wand travel and fringe benéLits for all employees. Cost center 200 pays. for the ~ 
plant and maintenance of the facility which. “includes rent, utilities, insurance ’ 
custodial services, Cost center 300 pays for shild care which includes all 
? " , tqaching staff. Cost \onter 400 pays for food preparation and service. Cost 
center 500 pays for all social services, including items guch as parental partici- 
‘pation. * Cost center 600 pays for the. transportation of children to and from the 
center, field trips, etc. Cost center 700. pays for examinations and health care 
of the children, Cost center 800 pays for purchased slots in ogher programs who 
subcontract with the agency. | 
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. All of the. above fiscal information is -reportéd on a monthly invoice form 
ior -payment. « This information is then matched: with the units of service provided.- 


“from the aeporting Gutpeicet) conponent. From ‘these data a cost per ‘child can ~ 


be determined. However, the lasy conpanent “bwvolving the program component must . 
: be “inchuded in order to detemine the’ cost ‘analysig coefficient” or cast. benefit. 
ratio.” _We. feel. very strngly: ‘that by using, date! Prout just the’ ‘reporting a 
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> fiscal components , only oe cost atid fisis coefficients are obtained | rope 
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“the éyerhi quality of a program. 
. This: last. component, program, is the most difficult to sacertitn bacause.. 
jdt ‘usseises ‘the level of human service’ delivery’ “which is elusive ‘a difficult to: 


, obj ectively measure. However, it is in this area that the Child Development 


_ Program Evaluation Proj ect (CDPE) has been helpful. . _The instruments, interviews 


and: questionnaires developed are collectively. known as. the | CbPE. These». 


y) 
(See 


. questionnal res, assess ‘the program component of day care at threo levels: : 
Licensing level; 2) monitoring level; and 3) evaluative. or quality level. 
Figure 5) Within each of ‘these: peels the CDPB. instruments and. questionnaires 

administration ; environnontal : 
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safety; child. dovelopuent, nutrition, at services, a a and sic 


assess, >seven major areas within a day care program: 
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Each of these areas have items that measure eects with “State regula- 


; one. federal regulations or definitive research “in the field of child developttiont. 


Lach item has a weight ee to it and will only ‘be reported if the item is found 


out of compliance... YALL "of these items are then added to. come up with a total score 


‘thet reflects compliance level.. Titese data are then put into an equatict with the 


ke 


‘reporting data and the fiscal data ‘ come up ae the cost analysis coefficient. 
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| (See Figyre 6) Also- these program data can be interfaced with ohly the reporting . 


data to produce the unit of aorvae: (See Figure 7) 
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“te above constitutes the basic structure of" ihe Bcopiad model... The unique | 


piece to’this mo 1 is the program component; “aur management information systems | 


‘ component ; but tiot in the level of detail that is presente 


Conclusi ion . \ 


a aspect of Boipad is its ee ta other se 


contain the fiscal ‘and reporting components and, to a lesset aa. the: program 
Bcopad. “The othér._ 
ce delivery systems. 


~ 


. @ 


The key to eaipreisasive evaluation of social servi programs is to develop 
criteria for the standardized assessment of the programmatic components of the 
services. This includes state, local and/or federal regulations, legislative 
siaiulates and professional goals and er The CDPE project has demonstrated 
that this task can be accomplished in the program area of child day care.’ We fool 
that’ the design — be used for ‘the comprehensive evaluation of most, af doe all, 


social service programs on a state, local, or national level. For example, the 


instruments have béen used to measure the 1968 Federal . ‘Interagency Day Care 


Requirements ; ; the.instrumonts can be modi Liod to ussoss wontul hoalth/montal 
returdation programs and- comet ence with adult-child qatios-can be determined, for 


' any, social service by using the mathematical models in Ecopad. 


: Once the criteria for measuring a program's compliance with a regulation or 


service intent is _¢ established we: are one step closer to dealing with the questions 


of whether-social service programs do what théy were intended to do. Coordinating, 


_ . the fiscal and statistical components with the programmatic component permits 


relative objective evaluation of the total] impact and cost of a social service 
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brogram. copad provides, the model for the integration of the programiatic, 


fiscal and reporting ‘components in both a naturalistic and acs lacie! gound 
manner. om | Ss - 7 . 
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